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Abstract 

For any right-angled Artin group, we show that its outer auto- 
morphism group contains either a finite-index nilpotent subgroup or a 
nonabehan free subgroup. This is a weak Tits alternative theorem. We 
find a criterion on the defining graph that determines which case holds. 
We also consider some examples of solvable subgroups, including one 
that is not virtually nilpotent and is embedded in a non-obvious way. 

1 Introduction and Background 
1.1 Introduction 

Let Ay be the right-angled Artin group of a finite simphcial graph T with 
vertex set X, i.e. the group with presentation 

Ar = {X\{xy = yx\ x is adjacent to y in T}). 

In this note we find a combinatorial condition on the graph F that indi- 
cates whether the outer automorphism group Out A-p of A^ contains a non- 
abehan free group. This extends a result of Gutierrez-Piggott-Ruane [U 
Theorem 1.10] which gives a condition for a particular subgroup of Out 
to be abelian. In fact, our theorem indicates a dichotomy: either Out^r 
contains a nonabehan free subgroup or 0utj4r is virtuahy nilpotent. This 
is a weak Tits alternative theorem. A true Tits alternative theorem would 
consider all subgroups of Out^r; Charney-Vogtmann [T] recently proved 
such a theorem for a large class of right-angled Artin groups. 

Automorphism groups of right-angled Artin groups are sometimes de- 
scribed as intermediate between automorphism groups of free groups and 
integer general linear groups, which are extreme examples. This result is 
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a first attempt to discern the cases wliere this idea seems reasonable, since 
Aut-Fri and GL(n, Z) both have nonabehan free subgroups for every n > 1. 

To state the theorem, we review some notions on graphs. Recall that the 
link lk{x) of a vertex x G F is the set of vertices adjacent to x, and the star 
st(x) is lk(x) U {x}. Domination is a useful relation that was considered by 
Servatius |;6, Section IV]: 

Definition 1.1. For x,y £ T, say y dominates x if lk(x) C st{y); denote 
this hy y > X. Say x and y are domination equivalent if x < y and y < x; 
denote this by x ~ y. 

Next we consider the notion of a separating intersection of links defined 
by Gutierrez-Piggott-Ruane [H Definition 1.9]. 

Definition 1.2. The graph F has a separating intersection of links if there 
are two vertices x,y G F such that (1) x is not adjacent to y and (2) there 
is a connected component of F\(lk(x) n lk(y)) not containing x or y. 

Now we state our main result. 

Theorem 1.3. Consider the following conditions on a graph T: 

1. F contains a domination- equivalent pair of vertices. 

2. F contains a separating intersection of links. 

If either condition holds, then Out contains a nonahelian free subgroup. 
If both conditions fail, then Out is virtually nilpotent. 

Proof of Theorem \1.3l If either condition holds, then Out^r contains a 
nonabelian free subgroup, by Lemmas 12.11 and 12.21 below. If both con- 
ditions fail, then Proposition 12.111 below produces a finite-index nilpotent 
subgroup. □ 

In Definition 12. 10^ we define a number depth(F) that can be read off 
of the graph F. If Out^r is virtually nilpotent, then a certain natural 
finite-index subgroup of Out turns out to be nilpotent of class depth(F). 
Further, every finite-index nilpotent subgroup of Out has nilpotence class 
at least depth(F). See Proposition 12.111 below for details. 

In Section [23} we consider a few other conditions that imply Out con- 
tains a nonabelian free subgroup. Then we construct examples of graphs F 
with Out Ay containing finite-index nilpotent subgroups of arbitrary nilpo- 
tence class. 

The corollary below follows from Theorem 11.31 by standard arguments. 
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Corollary 1.4. IfT is a graph such that Out^r has a solvable, finite-index 
subgroup, then every solvable subgroup of Out A-p is virtually nilpotent. 

Of course, for n > 3 the group GL(n, Z) contains examples of solvable 
subgroups of infinite index that are not virtually solvable. Given Corol- 
lary [L4l one might conjecture that a solvable subgroup of Out^r that is 
not virtually nilpotent must be essentially contained in an embedded copy 
of GL(n, Z). In Section [Sj we produce an example where this is not the case. 

1.2 Background 

We will use the following four classes of automorphisms. The inversion of 
X £ X is the automorphism sending x to x~^ and fixing X — {x}. If vr is an 
automorphism (a symmetry) of the graph F, then the graphic automorphism 
of vr is the automorphism sending x to 7r(x) for each x G X. If x € X UX~^ 
and y is a connected component of F — st (x) , the partial conjugation of Y by 
X is the automorphism sending y to x^^yx for each y GY and fixing X — Y. 
Denote this automorphism by CxX- If x G X U X~^ and y £ X are distinct 
and X > y, then the transvection of y by x is the automorphism sending y to 
yx and fixing X — {y}. Denote this automorphism by Tx,y Sometimes we will 
refer to the automorphism just defined as the right transvection, and refer 
to its conjugate by the inversion in y as the left transvection. The multiplier 
of a transvection Tx^y is x and the multiplier of a partial conjugation Cy^y 
is y. Servatius defined these automorphisms and showed that they are well 
defined in [6| Section IV]. Laurence [5] proved the following, which was a 
conjecture of Servatius. 

Theorem 1.5 (Laurence |5j). The finite set of all transvections, partial 
conjugations, inversions, and graphic automorphisms is a generating set of 
Aut Ar. 

Of course the images of these generators form a finite generating set for 
Out j4r. Since we are working in Out in this paper we will demand that 
partial conjugations are not inner automorphisms. Specifically, whenever we 
declare that Cy^y is a partial conjugation with multiplier y, we also assume 
Y and F\(st(y) U Y) are both nonempty. 
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2 Proof of the dichotomy 

2.1 Conditions for free subgroups 

Lemma 2.1. IfT contains distinct x,y with x ^ y, then Outvlr contains 
a nonabelian free subgroup. 

Proof. Let x, y G F be vertices with x ~ y. Let G be the subgroup of Out Ar 
generated by the images of r^y and t^,^.. The vector space ifi(j4r;M) has 
a basis given by the vertex-set of F; note that G leaves the 2-dimensional 
subspace V = {[x], [y]) invariant. Let ^ C ^ be the set of a[x] + b[y] with 
\a\ > \b\ and let B C V be the set of such vectors with \b\ > \a\. It is easy to 
see that A and B are nonempty, {T^^y)^:{B) C A and {Ty^^)^{A) C B. Then 
by the well-known Table- Tennis Lemma (see de La Harpe ILB.24]), we 
see that G is free of rank 2. □ 

Lemma 2.2. IfT contains a separating intersection of links, then Out^r 
contains a nonabelian free subgroup. 

Proof. Let x, y, z G F with y not adjacent to z and lk(y) n lk(z) separating 
x from both y and z. Let Y be the component of x in F\lk(y) and let Z 
be the component of x in F\lk2;. The hypotheses imply that y ^ Z and 
z ^ Y. Let G be the subgroup of Aut Ar generated by Cy^ and Cz^z and 
let G < Out be its image. Then G fixes y and z, and therefore contains 
no nontrivial inner automorphisms. Therefore the projection G ^ G is an 
isomorphism. 

Map G to the free group F2 = (y, z) by sending a € G to the unique 
w G {y,z) with a{x) = w~^xw. It is easy to see that this map is a homo- 
morphism with Cy^y mapping to y and Cz^z mapping to z. Since an inverse 
homomorphism i<2 — > G is easy to construct, we see that G and G are free 
of rank 2. □ 

2.2 Conditions for virtual nilpotence 

Lemma 2.3. Suppose x, y and z are in F such that x is not adjacent to y, 
lk(x) separates y from z and lk(y) separates x from z. Then lk(x) PI lk(y) 
separates x and y from z and therefore F contains a separating intersection 
of links. 
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Proof. Suppose lk(x) lk(y) does not separate both x and y from z. Then 
there is a shortest path from z to x or y through r\(lk(x) lk(y). Starting 
from z, the first time this path hits lk(x) Ulk(y) must also be the last, or else 
there would be a shorter path. Then the hypotheses imply that the point on 
the path in lk(x) U lk(y) must also be in lk(x) fl lk(?/), a contradiction. □ 

Lemma 2.4. Suppose x,y gT with x not adjacent to y, we have x > y and 
st(y) separates T. Then F contains a separating intersection of links. 

Proof. Let z be in a component of r\st(y) not containing x. This means 
lk(y) separates z from x. Since x > y, we know lk(x) fl lk(y) = lk(y), so 
lk(x) n lk(y) separates z from x and y. Therefore F contains a separating 
intersection of links. □ 

Lemma 2.5. Suppose T does not contain a separating intersection of links. 
Suppose a and (3 are automorphisms that are either partial conjugations or 
transvections (or one of each) and that a and (3 fix each other's multipliers. 
Then a and (3 commute in Aut Ay . 

Proof. Let x be the multiplier of a and let y be the multiplier of (3. If 
X = y^^ or X is adjacent to y then a and (3 commute, so assume x and y are 
distinct and not adjacent. Suppose there is some z G P such that neither a 
nor /? fixes z. 

Suppose X is adjacent to z. Then a is a transvection (partial conjugations 
fix the links of their multipliers) and x > z. If y > z, then y is adjacent to 
X, counter to our assumption. If y ^ z, then /? is a partial conjugation and 
y is not adjacent to z. This implies that x and z are in the same connected 
component of r\lk(y), meaning that (3 cannot fix x and change z. This 
contradiction implies that x is not adjacent to z, and similarly, that y is not 
adjacent to z. 

Suppose lk(x) does not separate y from z. Then x ^ z and a is a 
partial conjugation. However, in that case a cannot fix y and change z. So 
lk(x) separates y from z, and similarly lk(y) separates x from z. Then by 
Lemma |2.3| we have that T does contain a separating intersection of links, 
which is a contradiction. From this we deduce that for each z € F, either a 
fixes z OT (3 fixes z. This is enough to deduce that a and (3 commute. □ 

In the case that a and (3 are partial conjugations, the following lemma 
is a special case of Theorem 1.10 from Gutierrez-Piggott-Ruane [4j. 

Lemma 2.6. Suppose P does not contain a separating intersection of links. 
Let a he a partial conjugation. Suppose that (3 is a transvection fixing the 



5 



multiplier of a, or that P is a partial conjugation (not necessarily fixing the 
multiplier of a). Then the images of a and [5 commute in Out^r- 

Proof. Suppose the multipliers of a and j3 are distinct (otherwise a and (3 
commute). Then possibly by multiplying a and (3 by inner automorphisms, 
we may assume that a fixes the multiplier of /?, and if /3 is a partial con- 
jugation, we may assume that (3 fixes the multiplier of a. The lemma then 
follows from Lemma 12.51 □ 

Lemma 2.7. Suppose conditions ([T|) and ([2]) from Theorem \1.3\ both fail. 
Suppose a = Tx,y is a transvection and P is a transvection or partial conju- 
gation with multiplier y^^. Let 7 be any commutator of a or a"^ with j3 or 
. Then ^ is a transvection or partial conjugation with multiplier x^^ in 
Out^r- Further, if P is a transvection acting on z^^ , then so is 7, and if 
P is a partial conjugation acting onYcX, then so is 7. 

Proof. If /3 is a transvection and doesn't fix x, then x ~ y and condition ([1]) 
holds. If /3 is a partial conjugation, then up to an inner automorphism we 
may assume that it fixes x. So assume P fixes x. 

We claim that x is adjacent to y. Let z € F be an element not fixed by 
p. If y is adjacent to z, then /3 is a transvection and y > z. Since x > y, this 
implies that x > z, and that x is adjacent to y. So suppose y is not adjacent 
to z. If X is not adjacent to y, then lk{y) separates x from z since P fixes 
X but not z. Then by Lemma 12.41 T contains a separating intersection of 
links, contradicting the failure of condition ([2]). So a; is adjacent to y. Then 
the lemma follows by a computation. □ 

Definition 2.8. A domination chain in L is a sequence of distinct vertices 
xi, . . . ,Xm of r such that Xm ^ Xm-1 > ••• > Xi. The length of the 
domination chain xi, . . . ,Xm is m — 1. The domination depth of x is the 
length of the longest domination chain with x as the dominant member. 

Definition 2.9. A domination chain Xm > • • • > xi is star-separation pre- 
serving if r\st(3;i) has two components Yi and I2 such that Yi (f_ st(xm) 
for i = 1,2. The star- separation depth of x € F is 

1 + max length(xm > • • • > xi) 

where the maximum is taken over all star-separation-preserving domination 
chains. 
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Definition 2.10. The depth depth(x) of a vertex x G F is maximum of 
the domination depth of x and the star-separation depth of x. The depth 
depth(r) of r is the maximum depth of its vertices. 

Proposition 2.11. The subgroup N of Out A-p generated by transvections 
and partial conjugations is finite index in Out Ar- If the conditions from 
Theorem both fail, then N is nilpotent of class depth(r). Further, ev- 
ery finite-index nilpotent subgroup of Out Ar has nilpotence class at least 
depth(r). 

Proof. Let S be the finite subset of Outylr consisting of the identity, the 
images of transvections (both right and left) and partial conjugations, and 
their inverses. Let be the subgroup generated by S and let P be the 
finite subgroup generated by images of inversions and graphic automor- 
phisms in Out^r- Note that P normalizes N (since conjugation by P 
leaves S invariant). By Laurence's theorem (Theorem II. 5p . Outj4r = PN 
and therefore A*" <l Out^r- By a classical group isomorphism theorem, 
OutAr/N = P/{PnN) and therefore N is finite-index in Out^r- (In fact, 
the failure of condition ([1]) implies that fi P = 1 and Out — P i>< N, as 
can be seen from the presentation for Autj4r in Day O Theorem 2.7].) 

Let k = depth(r). Let 5*0 = {1}, and let Si be the union of {1} with 
the set of tranvsections Tx,y with depth(x) — depth(7/) > k — i + 1 (and left 
transvections satisfying the same condition) and partial conjugations Cy^y 
with depth(y) > A; — z + 1 for i = 1, . . . , A;. The Si are nested and S is Sk- 

Let a ^ Si and (5 ^ Sj, for 1 < i,j < k. By Lemmas 12. 5 1 12.6) and 12.7} we 
see that if [a, /3] is nontrivial, then i -\- j > k -\- 1 and [a, (3] is a member of 
Si+j-k-i- Since i,j < k, we have that i + j — k — l<i,j. This is enough to 
deduce that A^ is nilpotent of class at most k. 

Select Xfc G r with depth(xfc) = k. By definition, there is a domination 
chain Xk > • • • > xi in F, such that either xi dominates a vertex xq, or 
r\ st(xi) has two components Yi,Y2 with Yi <f_ st(xA,.) for i = 1, 2 (depending 
on whether depth(xfc) is the domination depth or the star-separation depth, 
respectively). In the first of these cases, let a\ denote the transvection Ta;^^^:^, 
and in the second of these cases, let a\ denote the partial conjugation Cx^y^- 
For i = 2, . . . ,k, let Oj be the transvection Tx^^Xi-i- Then by Lemma 12. 7^ 
the element 

[• • • [[ai,Q2],a3], ■■■ ,ak] e Out^r 

is either a transvection Ty^xo or a partial conjugation Cy^y, where y = x^^ 
and Y = Y'i\st(y). If it is Ty^xo, it is obviously nontrivial in OutAr. If it 
is Cy^, it is nontrivial in Outj4r since there is an element of Y'i\st(y) that 
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is conjugated and an element of l2\st(y) that is not conjugated. So the 
nilpotence class of N equals depth(r). 

Now suppose that A^" is a nilpotent, finite-index subgroup of Out^r- 
Then N" intersects in a finite index subgroup A^'. Each of the ai, . . . , 
from the previous paragraph is of infinite order. Since A^' is finite index in 
A^, the intersection A^' n (oj) is finite index in (oj) for each i. In particular, 
each A^' n (oi) is nontrivial. So we have ai, . . . , G Z with a^' G A^' for 
each i. Then by the same reasoning as in the previous paragraph, we see 
that 

[•••[[<, «r],«3l, •••><]• 

is nontrivial. From this, we see the nilpotence class of A^' is also depth(r), 
and the nilpotence class of A^" is at least depth(r). □ 

The following needs no further proof. 

Corollary 2.12. The group OutAr is virtually abelian if and only if both 
conditions from Theorem \1.3\ fail and depth(r) < 1. 

Remark 2.13. It has long been known that Out^r is finite if and only if 
r contains no pair of vertices x, y with x > y and T contains no vertex x 
with r — st(x) disconnected. This is an easy corollary of Theorem 11.51 

2.3 Examples 

Corollary 2.14. The group Out j4r has a nonabelian free subgroup if any 
of the following conditions on T hold: 

• T is disconnected. 

• r contains a cut-vertex that breaks T into three or more components. 

• r contains non-adjacent vertices x and y with x > y and st(y) sepa- 
rating r. 

• r contains pairwise non- adjacent vertices x, y and z with x > y > z. 

Proof. In each case we find a domination-equivalent pair of vertices or a 
separating intersection of links in F, and Theorem 11.31 implies the corollary. 
The final condition is a special case of the second to last condition, which 
implies F has a separating intersection of links by Lemma 12.41 

Now suppose that F is disconnected. If F is edgeless, then any two 
vertices are domination equivalent. Otherwise some component of F has at 
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least two vertices. If each component of F is a complete graph, then any two 
vertices in the same component are domination equivalent. So we have some 
component of T that contains two nonadjacent vertices. Then F contains 
a separating intersection of links (for x and y not adjacent, lk{x) n lk(y) 
separates x and y from any vertex in another component). 

Now suppose F contains a cut-vertex z that breaks F into at least three 
components. Without loss of generality we assume F is connected. If the 
valence of z is less than 2, then F\{2:} has only one component. If for for each 
pair of distinct x,y G lk{z), either x is adjacent to y or lk(x) nlk(y) contains 
two or more elements, then F\{z} has only one component. Therefore F 
contains distinct, non-adjacent vertices x and y with lk{x) lk(y) = {z}. 
Then F\(lk(x) nlk(?/)) has at least three components and F has a separating 
intersection of links. □ 

Proposition 2.15. For each k >0, there is a graph F^ such that Out Ar^. 
contains a finite-index subgroup of nilpotence class k. 

Proof. For each k, we will construct a graph F^ with depth(Ffc) = k and 
such that Ffc satisfies the hypotheses of Proposition 12.111 We can take Fq 
to be the graph with one vertex. 

Now fix /c > 0. For the vertex set of F^, we will take a set of 2A;-|-2 vertices 
labeled as xq, ■ ■ ■ ,Xk, yo, ■ ■ ■ ,yk- Take the induced subgraph on {xi}i to be 
the complete graph on k vertices, and similarly for {yi}i. Further, connect 
Xi to yj by an edge i + j > k. These are the only edges of F^. 

Then Xk > yo, Vk > xq, and for < i < j < A; we have Xj > Xi and 
Uj ^ Ui- Since > 0, these are the only pairs which satisfy the domination 
relation. In particular, there are no domination-equivalent pairs. There are 
no vertices whose stars separate F, so the star-separation depth of all vertices 
is trivial. We compute all depths as equal to domination depths, and find 
depth(xi) = depth(yj) = i for i = 0, . . . , /c. Therefore depth(Ffc) = k. 

The only non-adjacent pairs of vertices are {xi,yj) and {xj,yi) for i+j< 
k. For such i,j, every element of F^ is adjacent to either Xi or yj. In 
particular, every element of Ffc\(lk(a:;i) n lk(?/j)) has a path of length one to 
either Xi or yj (and similarly for Xj and yi). Therefore F^, does not contain 
a separating intersection of links. □ 

3 A non-nilpotent solvable subgroup 

Whenever y C X is a clique with x ^ y for all x, y € Y , the transvections of 
elements of Y acting on each other generate an embedded copy of SL(|y|, Z) 
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inside Out Ap. When we have such a copy of SL(n,Z), say it is canonically 
embedded. Of course one can find non-virtuahy-nilpotent solvable subgroups 
of Outj4r inside canonically embedded copies of SL(n, Z) for n > 3. Given 
Corollarv 11.41 one might conjecture that when G < Out is solvable but 
not virtually nilpotent, there is H < Out a canonically embedded copy of 
SL(n,Z), such that H CiG is not virtually nilpotent. However the following 
example is not of this type. 

Proposition 3.1. Let T be the graph on three vertices {a, b, c} with a single 
edge from a to b. Let G be the subgroup o/Outj4r generated by the images 
of the elements {Ta,c,Tb,c,Ta,bTb,a} ■ Then G is a solvable group and is not 
virtually nilpotent. 

The intersection of G with the unique canonically embedded copy of 
SL(n,Z) in Outvlr is not virtually nilpotent. 

Proof. It is apparent that G does not contain any inner automorphisms, so 
G is isomorphic to the subgroup of Aut generated by these generators. 
Let Q = Ta,c; (3 = Tb^c, and let 7 = Ta^bTb,a- Since a commutes with b, we 
know that a commutes with p. A computation shows that 707"^ = 
and 7/37"^ = af3. It is easy to see that {a, f3) fl (7) = 1. From this we can 
see that G is the semidirect product Z iK 1?, where Z acts on by the 
matrix J). So G is solvable. 

On the other hand, for all A; > 0, the centralizer of 7^^ in G is (7). Let 
H he a finite index subgroup of G. Then H contains a positive power of 7 
and an element of G outside of (7). So H has trivial center and is therefore 
not nilpotent. In fact G is isomorphic to a lattice in the 3-dimensional Lie 
group sol; see Thurston [?i Example 3.8.9] for explanation. 

The only canonically embedded copy of any SL(n, Z) in Outj4r is gen- 
erated by Tq and Tb^a- However, the intersection of G with this subgroup is 
a copy of Z. □ 
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